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Abstract. Let Xr be a (generalized) flag manifold of a non-compact real semisimplc 
Lie group Gr, where Xr and Gr have complexifications X and G. We investigate the 
problem of constructing a graded star product on Po1(T*Xr) which corresponds to a 
GR-equivariant quantization of symbols into smooth differential operators acting on 
half-densities on Xr. 

We show that any solution is algebraic in that it restricts to a G-equivariant graded 
star product * on the algebraic part 1Z of Po1(T*Ar). We construct, when 1Z is 
generated by the momentum functions /i x for G, a preferred choice of ★ where fj, x -k(f) 
has the form /j, x (j) + \{[i x , <fi}t + A x (<f))t 2 . Here A x are operators on 1Z which are not 
differential in the known examples and so \i x ★ (j) is not local in </>. 

1Z acquires an invariant positive definite inner product compatible with its grading. 
The completion of 1Z is a new Fock space type model of the unitary representation of 
G on L 2 half-densities on X. 



1. Introduction 

The equivariant deformation quantization (EDQ) problem for cotangent bundles is 

to construct a graded GR-equivariant star product * on the symbol algebra Po1(T*Xr) 

where Xr is a homogeneous space of a real Lie group Gr. We require that specialization 

of ★ at t = 1 produces the algebra 2)(Xr,£) of smooth differential operators for some 

G]R-homogeneous line bundle C. Then * corresponds to a quantization map Q from 

Pol(T*X K ) onto 2)(Xr,£); G R -equivariance of * amounts to GR-equivariance of Q. 

Motivated by geometric quantization (GQ), we take C to be the half-density line 
i i i 

bundle £Z. Let 2)?(Xr) = ID(Xr,£j| »)■ This choice of £ is naturally consistent with 

our requiring parity for *. 

If Gr is compact, the geometric methods of Fedosov should admit an equivariant 



version which leads to a positive solution to this problem; see e.g., [[B-N-P- Wj] . The 
resulting star product would be local, i.e. bidifferential, and so would extend to the full 
algebra of smooth functions on T*Xr. 

If Gr is not compact, the situation is very different. The known geometric methods 
break down and we expect there is no bidifferential solution in general. For instance, 
when Gr = SX n+1 (IR) and X R = MF n {n > 1), Lecomte and Ovsienko constructed in 
||L-0|| a unique solution for Q. The corresponding star product on Pol(T*MP n ) is not 



local, but locality is violated in a nicely controlled way; see [Q. We imagine this star 
product will ultimately be "explained" by some new non-local quantization scheme set 
in a more general framework. 

In this paper, we investigate the EDQ problem for T*Xr when Gr is a non-compact 
real semisimple Lie group and Xr is a flag manifold of Gr. We assume that Gr and 

l 



X^ have complexifications G and X. Flag manifolds are the most familiar compact 
homogeneous spaces of G^; they exemplify the phenomenon of a big symmetry group 
acting on a small space. The existence of Q is known in only the two cases: when X R is 
MP™ as discussed above or ( |P-L-Q| ) when Xr is the projectivised cone of null vectors 
in RP>i, p + q > 5, and G R = SO(p, q). 

We show in §|5] that any solution Q is algebraic in the sense that it maps the algebraic 
part TZ of Po1(T*Ar) onto the algebraic part V of D^(X^). In the "good case" (for 
instance when G = SL n (C) or if X is the full flag manifold) TZ is generated by the 
momentum functions \i x where x lies in g = Lie(G). Then TZ = S(g)/I and V = U(g) / J . 

So by restriction any solution Q defines a G-equivariant quantization map q : TZ — > T>. 
It is easy to describe all such maps q (§0). This suggests that we construct a preferred 
choice of q, i.e., one that is special in some way, and then try to extend q to Q, or 
equivalently, extend the corresponding star product on TZ to Po1(T*Xr). See and 
§ PH| for some preliminary ideas on the extension problem. 

We construct a preferred choice of q in Theorem |6.1| , for the good case. Here is our 



method. Results in representation theory of Conze-Berline and Duflo ( HCB-D Q and 
Vogan ([[VI]]) give a canonical embedding A of D into the space of smooth half-densities 
on X (§^|); here we regard X as a real manifold. We give a new geometric formula for 
A in (|8.1|). The natural pairing J x a (3 of half- densities induces a positive definite inner 
product 7 on T>. The 7-orthogonal splitting of the order filtration on T> defines our q. 

In this way, TZ acquires a positive definite inner product = 7(q(0), q(V0) where 

the grading of TZ is orthogonal. Then (-|-) is new even if q was unique to begin with (so 
if the representation of G on TZ is multiplicity free). The completion of TZ is a new Fock 
space type model of the unitary representation of G on L 2 half-densities on X (§|T2|). 

Now q defines a preferred graded G-equivariant star product * on TZ. We find in 
Corollary |9.3| that the star product fi x * of a momentum function with an arbitrary 
function in TZ has the form fi x (p + + A x ((p)t 2 where A x is the (-|-)-adjoint of 

ordinary multiplication by (a is a Cartan involution of g). This property that 

is a three term sum uniquely determines q (Proposition |11.1| ). The A x completely 



determine *, but they are not differential in the known examples; see §10. Thus fi x * 
is not local in 0. 

An important feature is that T> has a natural trace functional T (Proposition |8]4]) . 
We give a formula computing T by integration in ( |8.3| ). Then = T(q(0)q(-0 ')) 

where a is some anti-linear involution of TZ; see ( |11.2 ). 

The philosophy here is that the irreducible unitary representation of G on L 2 half- 
densities on X, modeled on TZ, should occur at the root of a solution to the EDQ 
problem for T*Xk. (This is certainly true when q is unique.) The properties of this 
model, in particular the interaction between the Poisson algebra structure on TZ and 
the inner product (-|-), should control if and how * extends from TZ to Po1(T*Xm). 

I thank Pierre Bieliavsky, Jean-Luc Brylinski, Michel Duflo, Christian Duval, Simone 
Gutt, Valentin Ovsienko, Stefan Waldmann, and Alan Weinstein for useful conversations 
last summer. I especially thank David Vogan for discussions in November 1999 which 
led to this paper. 
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2. Cotangent bundles of flag manifolds 



Let Gr be a non-compact connected real form of a complex semisimple Lie group 
G. Let Xr be a (generalized) flag manifold of Gr; then its complexification X is 
a (generalized) flag manifold of G. So Xr = Gr/Pr and X = G/P are compact 
homogeneous spaces. The classification of flag manifolds is well known. 

For example, if Gr = SL n (M) then G = SL n (C) and their flag manifolds are X d (M) 
and X d (C) where d = (d^ . . . ,d 8 ) with 1 < d x < • • • < d s < n - 1. Here X d (F) 
parameterizes the flags V — (Vi C • • • C V s ) in F n where dimVj = dj. The simplest 
cases are the grassmannians of /c-dimensional subspaces in M. n and C n . Here the flag 
manifolds of SL n (R) and SL n (C) are in natural bijection; this happens whenever Gr is 
the so-called split real form of G. 

The smooth action of Gr on Xr lifts canonically to a Hamiltonian action on T*X R 
with moment map //r : T*Xr — > gjjj. Similarly, the holomorphic action of G on X lifts 
canonically to a Hamiltonian action on T*X with moment map /i : T*X — > g*. Then 
/Wr = /-*|t*x r - These moment maps embed the cotangent spaces of Xr and X into g^ 
and g*. In our example, the cotangent space of X d (F) at V identifies with the subspace 
of sl n (F) consisting of maps e : F n -> F n such that e(Vj) C V^. 

Let Po1(T*Xr) be the algebra of complex- valued smooth functions on T*Xr which 
are polynomial on the cotangent fibers. Then we have the algebra grading 



by homogeneous degree along the fibers. Clearly Po1(T*Xr) is a graded Poisson algebra 
where {0, ip} is homogeneous of degree j + k — 1 if and ip are homogeneous of degrees 
j and k. We define h- > <p a by <p a = (—l) d <f) if <fi is homogeneous of degree d; then 
{<f),ip} a = — {<p a , ip a } . We define <fi \— > <p by pointwise complex conjugation. 

The Hamiltonian action of Gr on T*Xr defines a natural (complex linear) represen- 
tation of Gr on Po1(T*Xr). Then Gr acts by graded Poisson algebra automorphisms 
which commute with a and complex conjugation. The corresponding representation of 
g on Po1(T*Xr) is given by the operators {/j, x : •}, x E g, where /i x G Po1 1 (T*Xr) are 
the momentum functions. 

Po1(T*Xr) is interesting because it is the algebra of symbols for (linear) differential 
operators acting on sections of a line bundle over Xr. 



Our motivating problem is to construct a graded GR-equivariant star product (with 
parity) on A = Pol(T*X R ). This means that we want an associative product * on A[t] 
which makes A[t] into an algebra over C[t] in the following way. If 0, ip G A, then the 
product has the form 



Pol(T*XR) = ©~ Pol d (T*XR) 



(2.1) 



3. Equivariant star product PROBLEM FOR T*Xr 



* v = u + 1^, w + Er= 2 c p(^ ^ tp 



(3.1) 
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where the coefficients C p satisfy 



(i) C p {<f), xp) G A j+k - p if </> G A j and G A k 

(ii) C p {<j>^) = {-lYC p {^^) 

(hi) * ijj = (j) -k ip (3.2) 

(iv) C p (-, •) is local on Xr 

(v) fi x * (J) — (f) -k [i x = t{fi x , (j)} for all a; G g 

Axiom (ii) is the parity axiom. (Dropping parity amounts to dropping (ii) and relaxing 
( |3.1| ) from Gi(0, ?/>) = h{4>, i/j} to Ci((f>, ip) — Gi (■?/>, 0) = {4 ) i4>}-) 111 axiom (hi), we have 
extended pointwise complex conjugation to A[t] so that (f)t l = <f)t % . Axiom (iv) means 
that if (f) or ip vanishes identically on T*U, where U is open in Xr, then C p (4>, ip) 
vanishes identically on T*U. Then the operators C p = C p (-,-), and hence the star 
product, extend naturally from Pol(T*X R ) to Po\(T*U). 

Axiom (v) is often called strong invariance - we use the term "equivariant" . This is 
an important notion because it corresponds to equivariant quantization of symbols (see 
§f|). Strong invariance implies the weaker notion of invariance, which means that the 
operators C p are G^-invariant. 

We note that (iv) is much weaker than the familiar axiom that requires locality on 
T*Xr. Indeed locality means that the C p , and hence the star product, are bidifferential. 
It turns out that bidifferentiality is too strong a geometric requirement in our situation, 
but we believe it can be modified in a controlled way consistent with (iv); see §[IT)|. 

At t — 1, * specializes to a noncommutative product on B = A[t]/(t — 1); this 
works because of axiom (i). Then B has an increasing algebra filtration (defined by the 
grading on ^4) and the obvious vector space isomorphism Q : A — » B induces a graded 
Poisson algebra isomorphism from A to gr B. Via Q, the structures on A pass over to 
B. Axiom (ii) implies that a defines an algebra anti-involution (3 on B and (hi) implies 
that complex conjugation on A defines an anti-linear algebra involution a > a on B. 
By (v), B acquires a representation of compatible with everything. 

We can find a nice candidate for B by asking for compatibility between deformation 

quantization and geometric quantization. Geometric quantization of T*X K produces the 

Hilbert space Tt of square integrable half-densities on Xr, where half- densities are the 

i 

(complex- valued) sections of the half-density line bundle E\ . If we ask that B operates 

on (a dense subspace of) H, the obvious candidate for B is the algebra D^(Xm) of 

i 

smooth differential operators for E\ . 

Fortunately, D^(Xk) already has all the structure discussed above. It has the order 

filtration and the principal symbol map identifies grS^Xu) with A. Also 3)5 (Xr) 

admits the pointwise complex conjugation map a ^ a defined by a(<r) = a(a) where 

a i— > a is pointwise complex conjugation of half-densities. There is a canonical Gr- 

invariant algebra anti-involution j3 of D^(X^) such that f3(4>) = <fi for (j) G ^4° and 

/?(?7i) = —ni if 7/1 is the Lie derivative of a vector held n on Xr. Then (3 induces a 

upon taking principal symbols. Finally, we have a compatible representation of Gr on 
j i 

2)2(Xr) because the line bundle £| is GR-homogeneous. 

4 



We have the Lie algebra homomorphism g — > D^(X^), x h- > r] x , where rf is the 

complex vector field on X K defined by x. The representation of q on ®?(X®) by the 
operators [rjf, •] corresponds to the natural representation of G-r. (As is often done, we 
complexify the group representation at the Lie algebra level.) 

4. Quantizing symbols into differential operators equivariantly 

Now that we have decided upon B = D^(X^), we can reformulate our star product 
problem in terms of quantization maps. To begin with, we can axiomatize the properties 
of our vector space isomorphism Q : A —>■ B from 

(i) if G A d then the principal symbol of Q(0) is 

(ii) 6(0°) = Q{<l>Y 

(iii) Q(0) = Q(0) (4.1) 

(iv) Q is local on X K 

(v) Q(fi x ) = r)% and 0}) = [77? , Q(0)] if x G 

Axiom (iv) means that if [/ is open in Xr and vanishes identically on T*U then the 
differential operator Q(4>) vanishes identically on U. In (v), we used the semisimplicity 
of to get Q(fi x ) = rfi. Axiom (v) means that Q is 0-equivariant. This amounts to 
G]R-equivariance. 

We call Q a G^-equivariant quantization map. We can recover * from Q by the 
formula 0* ^ = QT 1 {Qt{<P) QtW) where Qt{(f)t p ) = Q t {<P)t j+p if G A>. In this 
way, we get a bijection between graded equivariant star products on A and equivariant 
quantization maps (up to algebra automorphisms of D^(X^) which are compatible with 
principal symbols, the Cu-action, etc.). 

5. Algebraicity of the EDQ problem for T*X r 

Since A is a complex algebraic (projective) variety, we can consider the algebraic 

parts TZ and T> of Po1(T*Ak) and 2) 3 (Xr). By this we mean that TZ is the subalgebra 

of Pol(T*A K ) corresponding, by restriction of functions, to the algebra R(T*X) of 

regular functions on the quasi-projective variety T*X. Similarly, T> is the subalgebra of 

j 1 
Ds(Xr) corresponding to the algebra D^ lg (X) of algebraic twisted differential operators 

for the (locally defined) square root of the canonical bundle. We have R(T*X) ~ TZ 
1 

and T>l lg (X) ~ V; this follows since T*X R is a real form of T*X. 

1 

The action of G on X induces natural representations of G on R(T*X) and 2)^ (X), 
and hence on TZ and T>, which are both locally finite and completely reducible. (Locally 
finite for G means that every vector lies in a finite-dimensional G-stable subspace.) 
Thus TZ and T> have more symmetry than A and B. 

Clearly TZ contains the algebra TZ^ generated by the momentum functions fi x , i6g, 
and V contains the algebra V v generated by the twisted vector fields r] x . Soon (§|6| 

onwards) we will restrict to the case where TZ = TZ^ and T> = T> n . 

We can formulate the notion of a graded Gi- equivariant star product on TZ using the 
same axioms as in §|3]. (Axiom ( |3.2| )(iii) makes sense because TZ is stable under 1— ► 0. 
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Axiom ( p.2|) (iv) is vacuous as stated.) Similarly, once we establish grV = TZ, we can 
formulate the notion of a G^-equivariant quantization map q : TZ — > V using the same 
axioms as in §|j. In both cases, GR-equivariance easily implies G-equivariance. 

Proposition 5.1. (i) Any graded G-equivariant star product * on A restricts to a 
graded G-equivariant star product on TZ. 
(ii) We have grT> = TZ. Any G^-equivariant quantization map Q: A—> B restricts to 
a G-equivariant quantization map q : TZ — > T>. 

Proof, (i) We just need to show that * restricts to 71, i.e., if and if) belong to TZ 
then (p-kijj belongs to 7Z[t]. GR-invariance of * implies that * restricts to the GR-finite 
part A fi n of A. (A fi n is the subalgebra consisting of functions which lie in a finite- 
dimensional GR-stable subspace of A.) We will show that 1Z = Afi n . Certainly 7Z lies 
in Afin since G is locally finite on TZ. 

Now R d {T*X) identifies with the space V d = Pol^ oi (T*X) of holomorphic functions on 
T*X which are homogeneous degree d polynomials on the cotangent fibers. This follows 
from compactness of X. We will show that any <fi in A d f in extends to a holomorphic 
function (p ho1 in V d . 

Now V d is the (finite-dimensional) space of holomorphic sections of a finite rank 

vector bundle E d over X and A d is the space of smooth sections of E d \x R - Both 

E d \x R = Gr Xffe y d and E d = G x P V d are homogeneous vector bundles where V d is 

the base fiber of E d . Consequently we can identify A d and V d with certain spaces of 

functions Gr — > V d and G — > V d in the familiar way. If G is simply connected, every 

smooth GR-finite function on Gr extends uniquely to a holomorphic (G-finite) function 

on G. Using this, it follows easily that extends to <fi ho1 as desired. 

i 

(ii) We have grlD^ (X) = R(T*X) by ||Bo-Br| , Lem. 1.4] - their result goes through 



to the twisted case with the same proof. So gr V = TZ. 

Now T> lies in the GR-finite part Bfi n of B, since G is locally finite on T>. Using 
principal symbols, we find V = Bfi n , since gr Bfi n lies in Afi n = TZ. (In fact this proves 
gr Bf^ = Afin-) Clearly Q{A fin ) = B fin , and so Q(TZ) =V. □ 

We regard TZ and D as algebraic models of A and B. We know that TZ and T> are 
finitely generated algebras, and TZ is finite as a module over TZ a (see e.g. [B-Ko| ). At 



first sight TZ may seem to be too small to encode enough information about A. For 
instance, 7Z° = C while A is the infinite-dimensional algebra of smooth complex valued 
functions on Xr. But already TZ^ is "big enough" in the sense that 

Lemma 5.2. Any differential operator A on T*Xr is uniquely determined by its values 
A{4>) where <fi belongs to TZ a - 

Proof. This follows since the momentum functions fi x , x G 0r, form a complete set of 
functions (i.e. their differentials span the cotangent spaces) over some open dense set 
W in T*Xr. Indeed, the image of the moment map : T*A K — > is the closure of a 
single nilpotent orbit Or, and we can choose W = /^(Or). □ 

Proposition |5.1| suggests that we might try to solve to the EDQ problem posed in §|3] by 
finding a "preferred", or particularly natural, solution to the analogous G-equivariant 
problem for TZ and T>, and then trying to extend that solution to A and B. This 
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extension problem would have a unique solution, on account of Lemma |5.2| , if we found 
a star product on TZ given by bidifferential operators on T*X. This same kind of 
argument can still work if bidifferentiality is violated in a controlled way, by inverting 
certain nice invertible operators; see |B|, Th. 5.1] for an example and §|10|for a conjecture. 

In the next section we find a preferred G-equivariant graded star product on TZ. We 
do this under the hypothesis that TZ = TZ^. This is a hypothesis on (G,X) which is 
satisfied for instance if (i) G = SL n (C) and X is arbitrary ( |[K-P|| ), or (ii) G is arbitrary 
but X is the full flag manifold. 

This hypothesis was important in ||Bo-Brj| in studying noncommutative analogs of 
R(T*X); it is equivalent ([[Bo-Br|, Th. 5.6]) to the condition that the holomorphic 



moment map li : T*X — > g* has good geometry in the sense that li is generically 1-to-l 
and its image in g* is a normal variety. These conditions have been studied a lot in 
geometric representation theory, especially since the image of li is the closure of a single 
nilpotent coadjoint orbit O of G. 

Suppose TZ = TZfj,. Then TZ = S(g)/I where / is the (graded) ideal of functions in £(g) 
which vanish on O, and T> = U(q) / J where J is a 2-sided ideal in W(g) with gr J = I. 
The ideal / contains all casimirs (i.e., G-invariants in ®°[^ 1 S d (Q)). The casimirs generate 
/ if and only if X is the full flag variety. 



6. A PREFERRED STAR PRODUCT ON TZ 

Suppose * if) is a graded G-equivariant star product on TZ (see ^). This defines 
a noncommutative associative product o on K where o ip is the specialization at 
t = 1 of (j) -k if). Then we obtain a representation it of g © g on TZ given by ir x,y ((f)) = 
fi x o — o fi y . Notice that the equivariance axiom ( |3.2j )(v) says that the quantum 
operator ir x,x coincides with the classical operator •}. 

Theorem 6.1. Assume TZ is generated by ii x , x G g. Suppose -k is a graded G- 
equivariant star product on TZ where * corresponds to a G-equivariant quantization map 
q : TZ — > T>. (Such maps q always exist.) Then 

(I) The representation it of g©g on TZ is irreducible and unitarizable, i.e., there exists 

a unique positive definite invariant hermitian form (-|-) on TZ with (1|1) = 1. 
(II) There is a unique choice o/q ; and hence a unique choice of*, such that the grading 
TZ = ®™ =Q TZ d is orthogonal with respect to (-|-). Then 

tt^(0) = tf-V(f) + \{p?+u, 0} + A x -y(4>) (6.1) 

where A x , x G Q, are certain operators on TZ. 
Proof. The proof occupies §0^0- D 

We now discuss what unitarizable means and introduce some notations. To begin 
with, the restriction of n to Q dm9 = {(x, x) \ x G g}, i.e, the g-representation on TZ given 
by the operators tt x,x , corresponds to the natural G-representation on TZ. Thus TZ is a 
(fl © 0, G)-module in the sense of Harish-Chandra. 

Now unitarizability of tt means that there is a positive definite hermitian inner product 
(■|-) on TZ which is invariant for g" = {(x,a(x)) \ x G g}, i.e., the operators 7r x ' a ^ are 
skew-hermit ian. Here a is a fixed Cartan involution of g; we choose o compatible with 
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Gm so that a extends a Cartan involution of $Jr. Then a corresponds to a maximal 
compact subgroup G c with Lie algebra g c = {x G g \ x = <r(x)}. E.g., if g K = sI n (R), 
then take a(x) = —x l so that g c = su n . 

By a theorem of Harish-Chandra, the operators ti x ' <7 ^ then correspond to a unitary 
representation of G on the Hilbert space completion TZ oiTZ with respect to (-|-). If the 
TZ d are orthogonal, then TZ is the Hilbert space direct sum (B™ =0 7Z d . Notice that we end 
up with two very different actions of G: the graded algebraic action on TZ corresponding 
to g dm9 and the unitary action on TZ corresponding to g". 

7. Existence proof for q 

A G-equivariant quantization map q is completely determined by the subspaces T d = 
c\(TZ d ). This is immediate from ( |4.1| )(i). Then the decomposition T> = ©^ T d "splits 
the order filtration" in the sense that ©^ =0 T d = V< p . Referring to flO]) again, we 
see that the spaces T d are stable under f3, complex conjugation, and g (which acts by 
A i — > [r)i, A]). Conversely, any such splitting corresponds to a choice of q. 

Lemma 7.1. We can always construct a G-equivariant quantization map q : 1Z — » V. 

If the representation of G onlZ is multiplicity free, there is only one choice for q. 

Proof. By complete reducibility, we can find a g-stable complement Q d to D^_\ inside 
V<d- This gives a g-stable splitting of the order filtration; let p be the corresponding 
quantization map. The spaces Q d may fail to be stable under (3 and/or complex conju- 
gation. To remedy this, we "correct" p by putting p'(0) = \ (p(0) + p(0 Q )^) an d then 

p"(0) = | (p'(0) + p'(0) j • Now p" is a valid choice for q. 

If TZ is multiplicity free, then Q d is unique for each d, and so p is the unique choice 
for q. Notice that uniqueness of q does not require (ii)-(iv) in (|4.1|). □ 

In the multiplicity free case, the method explained in Remark |9.4j gives a sort of 
formula for q. We note that TZ is multiplicity free whenever the parabolic subgroup 
P (where X = G/P) has the property that its unipotent radical is abelian. For G = 
SL n (C), this happens when X is a grassmannian. The full classification of multiplicity 
free cases is well known. 

In general, there will be infinitely many choices for q; we can show using filtration 
splittings that the set of choices has the structure of an infinite dimensional afline space. 

8. Proof of (I) in Theorem |Q 

The quantization map q intertwines our representation it of q © g on TZ with the 
representation II of g © g on T> given by U x ' y (A) = r] x A — Arji. Indeed, q(0 o i/j) — 

q(0)q(VO and so q(7r e '»(0)) = IP'^(q(0)). 

Therefore proving ir is irreducible and unitarizable reduces to proving II is irreducible 
and unitarizable. For this, we need our hypothesis that TZ is generated by the \i x \ we 
use this freely from now on. 

Each rf extends uniquely to a holomorphic vector field £ x on X. We can regard X 

as a real manifold. Then D^(X) is the algebra of smooth differential operators on the 

i x 
space r(X, £x) of smooth half-densities on X. The Lie derivative lies in D^(X). 
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The map n x 1— > £f extends naturally to a G-equivariant algebra embedding A ^ A ho1 

2 2 

of V into 5)4 (X). Let 5 be the unique G c -invariant positive real density on X such that 
J x 5 = 1. Let be the positive square root of 5. We map V into r(X, by 

A(A) = A hol (5?) (8.1) 

Now T> acquires the G c -invariant hermitian pairing j(A, B) = j x A(A) A(B). 

Proposition 8.1. 7 is ^-invariant and positive definite. 

Proof, gMnvariance means that the operators IP'"^ are skew-hermit ian, or equiva- 
lently, the adjoint of LP' is — H°> a ( x \ So we want to show 

7 {rRA,B)= 1 (A,Br,f>) (8.2) 

* 2 

We have 7(7^ A, 5) = / x (f|A(A)) A(S) = - / x A (A) (£?A(5)); the last equality holds 
because f x £f(a(3) = for any half-densities a, (3. 

G c -invariance of 5^ means that + £? kills 5^ if a; £ g c , or equivalently £T +£1 kills 
#2 if x £ g. Using this and the commutativity of holomorphic and anti-holomorphic 
operators we find £| A(B) = -B hol ^ ix) (tfi) = -A^f* ) and so we get (p|). 

For positive definiteness, we just need to show that A is 1-to-l on T>. We expect 
there is a geometric proof of this, but we have not worked that out. Instead, we will 
use results from representation theory. This argument will be clear for experts in these 
matters and too technical for everyone else; so we just sketch it briefly. 

A is G c -equivariant and so A maps V into L(X, S x ) Gc ~^ n . We have V = U(q)/J 
where gr J = I. We can show that A is the same (up to scaling) as the map from 

U{q)/J to F(X,£|) Gc ~ /m defined by Conze-Berline and Duflo in ggg , §5.3 and Cor. 

6.3]. (This is the u ir = 0" case in their notation.) This follows easily because both 

1 

maps are g © g-equivariant; here g © g acts on T(X,£ X ) by the twisted vector fields 
g> y = g + gM. Next we need a suitable criterion for injectivity of the Conze-Berline- 

2 3 2 

Duflo map. We find it in Vogan's result |[V1| , Prop. 8.5] on injectivity of certain maps 
of induced modules into produced modules; see also |[V2| , §6]. □ 



Corollary 8.2. T> is isomorphic, via A, to the Harish- Chandra module of the natural 
unitary representation of G on L 2 (X,S X ). 

Proof. The Harish- Chandra module is T(X, £ x ) Gc ~f m . We just established injectivity of 
A. Surjectivity follows by ||CB-D| , Prop. 5.5] or by directly checking that the source and 



target contain the same irreducible G c -representations with the same multiplicities. □ 



Corollary 8.3. We have 7 (A, B) = r ){B a A ) 1) where B 1— > B a is an anti-linear algebra 
involution ofT>. 
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Proof. Since the rf{ generate V, we may assume B = rf^ ■■■rf 1 m . Then Q8.2Q gives 
y(A,B) = y(B a A,l) where B a = rf^ Vl) ■ ■ ■ if^ Vm) . This map B ^ B a gives a well- 
defined anti-linear algebra involution of V; indeed we have A(BI 3 ) = B a (8^). □ 

The formula T(A) = j(A, 1) defines a linear functional T on T>. Explicitly, 

T{A) = [ A ho \5?)5i (8.3) 
Jx 

Proposition 8.4. T is the unique G c -invariant linear functional on T> with T(l) = 1. 
Moreover T is a trace. We have ^(A, B) = T(AB a ). 

Proof. Clearly T is G c -invariant. Then T : T> — ► C is the unique invariant linear 
projection because the G c -action on T> is completely reducible and the constants are 
the only G c -invariants in T> (since the constants are the only G c -invariants in 71). 
T is g-invariant, i.e., TQ^A]) = 0. We write this as T{j]\A) = T^Ar]^). Iteration 

gives T(r]f ■ ■ ■ iff A) = T{Arf 1 1 ■■■rjf). This proves T(BA) = T(AB) . □ 



Now we can show that 7 is the unique g'-invariant hermitian form on D such that 
7(1, 1) = 1. Indeed suppose v is any such form. Then v(A, 1) = T(A) by the uniqueness 
of T. So O gives v(A,B) = u(B a A, 1) = T{B a A) = j(A, B). This uniqueness of 7 
implies II is irreducible. 

This completes the proof of Theorem |6.1| (I). Once q is chosen, (-|-) is given by 

<</#) = 7 (q(0), q(V0) = T (8.4) 
Finally we note that the irreducibility of II implies (and vice versa) 
Corollary 8.5. V is a simple ring. 



9. Proof of (II) in Theorem [O 



The graded pieces TZ d are orthogonal with respect to (-|-) iff their images q(7l d ) are 
orthogonal with respect to 7. So we have only one possible choice of q, namely the one 
such that q(7?. d ) = V d where ©^L V d is the 7-orthogonal splitting of the order filtration 
of T>. According to §0, we need to check 

Lemma 9.1. V d is stable under (3, complex conjugation, and g. 

Proof. G c -invariance of 7 implies that V d is g-stable. The other two follow easily using 
j(A, B) = T(AB U ) and the properties T(A?) = T(A), T(A) = T(A). □ 

Thus ©^L V d defines q. Then q defines a graded G-equivariant star product * on 1Z; 
this is the only one for which the sum ®f =0 1Z d is (-|-)-orthogonal. 

Proposition 9.2. This star product * satisfies 

TV * 7l k C 7l j+k © • • ■ © Ti\i-k\ t 2min{j,k) ( 91 ) 
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Proof. Since * is graded, it suffices to consider o. Let £(<p) and r(<f>) denote respectively 
left and right o-multiplication by 0. It is easy to check that the map fi x \— > fx"^ 
extends to a graded anti-linear algebra involution hh> 0°"( z ) of 1Z; this follows because 
the nilpotent orbit O is a-stable. It follows by (]S.2|) that the adjoint of £(<fi) is r(0 <J ). 

Suppose G 7^. Then the highest degree term in 0o-0, namely <fnf), occurs in degree 
j + k. If v G 7£ d and ^ occurs in o ip, then ip occurs in v o <p a and so d + j > fc. 
Similarly d+ A; > j. So d > |j — □ 

Corollary 9.3. For x G g and (p we have 

(i x *<f> = fi x <f) + ^{fi x ,<P}t + A x {<P)t 2 (9.2) 

where A x is the adjoint with respect to (■]■) of ordinary multiplication by /j, a ^ . 

Proof. Certainly ( |9.1p implies ( fJ.2p where A x (ip) = C 2 (fj, x ,il)) = C 2 (ip, ti x ). Now suppose 
G VJ and ip G . Because of orthogonality of the spaces TZ d we find {(fi\A x (ip)) = 



Now (^2) gives fl6.ip . This concludes the proof of Theorem 3J_. 

Remark 9.4. We know another method for constructing a G-equivariant quantization 
map r : 1Z — > T>. We start with the positive definite hermitian pairing h(/, g) = d g (f) on 
S(g), where d x is the constant coefficient vector field on g defined by d x (y) = —(a(x),y) 
and d gi92 = d gi d 92 . Let H be the h-orthogonal complement to I in S(q) where 71 = 
S(g)/I. Then H = ®^ =Q H d is graded. We put T d = p(s(if d )), where s : S(g) -> U(g) is 
the symmetrization map and p : U{q) — > X> is the natural projection. Then X> = ©J^qJF^ 
is a g-stable splitting of the order filtration. It is easy to see that T d is stable under /3, 
complex conjugation, and also a. So by §[7| this splitting defines r. 

Here is a formula for r: if we pick a basis X\, . . . , x m of g and CLi x ,...,i d ■ ■ ■ Xi d lies 
in H d , then 

r(E«u,.., d ^ ■■■^) = ^Zr a^vT^-'-V^ (9.3) 

where we sum over all permutations r of {1, . . . , d}. 

We conjecture that T d = V d , or equivalently, that r = q. This is obviously true in 
the multiplicity free case by uniqueness (Lemma |7. 1| ) . Analytic methods may well be 
needed to show r = q, just as we needed integration to establish the positivity of 7 (or 
even the weaker fact that 7 is non-degenerate on each space D<d)- 

Suppose X is the full flag manifold. Then H is Kostant's space of harmonic polyno- 
mials, and r is simply a p-shifted version of the map constructed by Cahen and Gutt in 
[ CJ-C| for the principal nilpotent orbit case. 



10. The operators A x on 1Z 

In Corollary |9]3] we saw that our star product * produces operators A x , x G g, on TZ 
Conversely, the A x completely determine *. This follows because, if we know the A x 
then using associativity we can compute (fi xi ■ ■ ■ fi Xn ) -kip by induction on n. Here ( |9.2| 
provides the first step n — 1, and also it propels the induction. 

Several nice properties follow from Corollary p.3| : 
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(i) A x is graded of degree —1, i.e., i.e., A x (7Z j ) C W~ x . 

(ii) The A x commute and generate a graded subalgebra of End TZ isomorphic to TZ. 

(iii) The A x transform in the adjoint representation of g, i.e., [t&^A 2 '] = where 
$ x = •} 

(iv) The map g x g — > C, (x, y) i— > A x (/j 1 y ), is a non-degenerate g-invariant symmetric 
complex bilinear pairing. 

The are not differential operators on 7?. in general. Indeed different iality fails when 
Cr = SX n+ i(R) and X R = MP n . In that case A x is a reasonably nice operator as it is 
the left quotient of an algebraic differential operator L x (of order 4) on the closure on 
O by the invertible operator (E + §)(£ + f + 1). Moreover L x extends to T*CP n . See 
flATi! and B. 



The A x determine * in a rather simple way, and so their failure to be differential should 
control the failure of * to be bidifferential. This issue is important in understanding if 
and how * extends from TZ to A (see the discussion in §|5|). 

We conjecture that A x is of the form A x = P~ X L X where (i) P and L x are algebraic 
differential operators on T*X, (ii) P is G-invariant and vertical so that P "acts along 
the fibers of T*X — > X" (iii) P is invertible on in fact P is diagonalizable with 
positive spectrum and (iv) the formal order of P~ l L x is 2. 

Motivated by this conjecture, J-L. Brylinski and the author construct in [|B-Br|l all 



invariant vertical differential operators on cotangent bundles of grassmannians. 

The X^l = MF n case discussed above is an example where (i)-(iv) works. That example 
was part of a quantization program for minimal nilpotent orbits (see [ |A-B1| , §1]). In 



fact, our conjecture here arises from a larger program we have on quantization of general 
nilpotent orbits. A proof our conjecture, coming most likely out of properties of (-|-), 
would give more evidence for our program. 

11. The inner product (-|-) on 1Z 

In Theorem |6.1| , the hermitian form (-|-) completely determines the star product *, 
and vice versa. To show this, it suffices (see § |i~0|) to show that knowing (-|-) is equivalent 
to knowing the A x . Certainly (-|-) produces A x , as A x is (Corollary |9.3|) the adjoint of 
<fr i — > ix a ^ x '(j). Conversely, suppose we know the A x . To produce (-|-), we only need to 
compute (4>\ip) for <p,ip G 7Z d , since W is orthogonal to 7Z k if j ^ k. By adjointness 
again we find 

(H X1 ■ ■ ■ /j, Xd \ip) = A a{xi) ■■■A a{xd) (i)), ilipeiz d (11.1) 

The cleanest formula for comes from (|8.4|) . Let T : TZ — > C be the projection 

operator defined by the grading of TZ. Notice that T is classical, i.e., we know it before 



we quantize anything. Recall the map i— > (j) a from the proof of Proposition |9.2| ; this 
is also classical. T and T correspond via q and so T is a o-trace by Proposition |3.4| ; we 
view this as the "quantum analog" of the fact that T vanishes on Poisson brackets. So 
( gg ) gives 

<</#) = T (q(0)q(^)) = T(0 o r), ^eTZ (11.2) 

For <fi, ip G 7Z d , this reduces to (4>\ip) = C^((p, , ip a ) where are the coefficients of *. 
We can now characterize * without the explicit use of symmetry and unitarity. 
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Proposition 11.1. The preferred star product * on 1Z we found in Theorem |67i] is 
uniquely determined by just the two properties: (i) * corresponds to a G-equivariant 
quantization map q : TZ — > T>, and (ii) * satisfies fl9.2|) where the A x are any operators. 

Proof Suppose * satisfies (i) and (ii). Then * satisfies (|9.1|) and so T(7^- J o 7^ fe ) = for 
j 7^ k. Equivalently, 7~(V J 'V ) = if j 7^ fe. We claim that this uniquely determines 
©^ V d among all g-stable splittings of the order filtration of T>. For it implies that 
the spaces V d are orthogonal with respect to the symmetric bilinear pairing \(A, B) = 
T(AB). But we know A is non-degenerate on V d ; this follows because V d is a-stable 
and X(A, A a ) = j(A, A) is positive if A 7^ 0. So there is only one A-orthogonal splitting. 
This proves our claim. □ 

We remark that ( j9.2|) and fl9.1|) are in fact equivalent. 

Remark 11.2. The involution ip 1— > t\) a differs from pointwise complex conjugation 
ip 1— > ip precisely because G R is not compact. But there is a G^-invariant indefinite 
hermitian pairing on T> which may be more natural for our quantization problem. This 
is t(A,B) = T(AB). The positivity of 7 easily implies that there is a unique r- 
orthogonal splitting of the order filtration of T>, which is again (B°^ Q V d . So r produces 
the same quantization map q. Then r corresponds to the pairing (<p\ip) = T(<f> o ijj). 

12. TZ IS A FOCK SPACE TYPE MODEL OF L 2 (X,£?) 

Combining the discussion in §|6| with our work in §[8], we find 

Corollary 12.1. The Hilbert space completion TZ = ®°^ =0 lZ d of TZ with respect to (-|-) 
becomes a holomorphic model for the unitary representation of G on L 2 (X,£?). We 
have, for the Harish- Chandra modules, the explicit intertwining isomorphism 

iz-^v -^r(x,4) Gc ~ /m (12.1) 

While L 2 (X, ££) is itself a Schroedinger type model, our TZ is a generalization of the 
Fock space model of the oscillator representation of the metaplectic group. This follows 
for three reasons. First, TZ is the completion of a space of "polynomial" holomorphic 
functions. (We conjecture that TZ is a Hilbert space of holomorphic functions on T*X. 
This is true when G R = SL n+1 (R) and X R = MP n - see HCT5| .) 

Second, the action of the skew-hermitian operators tt x,(I ^ corresponding to the non- 
compact part of $3" is given by creation and annihilation operators. For the non-compact 
part of 0" is {(ix, —ix) \ x G g c } and (|6.1|) gives 

n ix,-ix = 2jJ ix + 2A ix ( 122 ) 

The multiplication operators /i JX are "creation" operators mapping TZ d to TZ d+1 , while 
the A lx are "annihilation" operators mapping TZ d to TZ d ~ x . 

Third, the operators tc x ' x corresponding to the compact part {(x, x) \ x E g c } of g" are 
just the derivations {fi x , ■} and these map TZ d to TZ d . Notice that the operators \i %x and 
{fi x , ■} are classical objects, while the A lx are quantum objects (which encode (-|-)). 

This gives new examples in the orbit method. For TZ identifies with the algebra of 
G-finite holomorphic functions on the complex nilpotent orbit O associated to T*X (cf. 
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§||). We may regard O as a real coadjoint orbit of G, where O is enjoying a complex 
polarization. Then Theorem |6.1| and Corollary |12.1| give a quantization of O. 
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